(19) 



(12) 


(43) Date of publication: 

01.10.1997 Bulletin 1997/40 

(21) Application number: 97108890.1 

(22) Date of filing: 17.02.1993 


Europaisches Patentamt 
European Patent Office 
Office europ6endes brevets (11) EP 0 798 550 A1 

EUROPEAN PATENT APPLICATION 

(51) Int CI. 6 : G01N 15/14, G02B 21/00 


(84) Designated Contracting States: 
BECHDEESFRGBITUNL 

(30) Priority: 18.02.1992 US 837051 

(62) Document number(s) of the earlier application® in 
accordance with Art. 76 EPC: 
93102433.5 / 0 557 871 

(71) Applicant: CELL ANALYSIS SYSTEMS, INC. 
Elmhurst, Illinois 60126-4944 (US) 

(72) Inventors: 

• Bacus, James W. 
Hinsdale, Illinois 60521 (US) 


• Bacus, James V. 
Lombard, Illinois 60148 (US) 

• Wagner, Robert E. 
Chicago, Illinois 60657 (US) 

(74) Representative: Selting, GGnther, Dipl.-lng. et al 
Patentanwaite 

von Kreisler, Selling, Werner 
Postfach 10 22 41 
50462 Kdln (DE) 

Remarks: 

This application was filed on 03 - 06 - 1997 as a 
divisional application to the application mentioned 
under INID code 62. 


(54) Microscope slide viewing apparatus 

(57) The microscope slide viewing apparatus com- 
prises a slide tray (62a) for securing a plurality of slides 
(101-108) in predetermined positions, said slides (101- 
108) being secured such that an upper surface thereof 
is substantially coplanar. Reference marked means 
having a surface marked with a plurality of substantially 

FIG-Ub 


identical reference patterns is provided. Means for hold- 
ing said slide tray (62a) in a substantially fixed position 
with respect to said reference marked means are pro- 
vided such that one of said reference patterns can be 
viewed on each of said plurality of slides (101-108). 
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Description 

This invention relates to a microscope slide viewing 
apparatus for cell analysis. 

The diagnosis and/or prognosis of a patient's condi- s 
tion frequently includes the removal of a eel! sample, 
such as a tissue mass, from the patient. Although an 
attending physician may have good intuition regarding 
the patient's diagnosis and/or prognosis, confirmation of 
the diagnosis with histological examination of the cell 
sample removed from the patient is necessary. The his- 
tological examination entails cell staining procedures 
which allow the morphological features of the cells to be 
seen relatively easily in a light microscope. A patholo- 
gist, after examining the stained cell sample, makes a 
qualitative determination of the state of the tissue and 
reaches a conclusion regarding the prognosis for the 
patient. While this diagnostic method has a long history, 
it is somewhat lacking in scientific rigor since it is heavily 
reliant on the subjective judgment of the pathologist and 
it is extremely time-consuming. 

The alternative to the strictly qualitative and time- 
consuming human analysis is automated cell analysis 
where the pathologist uses specialized equipment to 
perform the analysis. Flow cytometry equipment is one 
type of automated apparatus for cell analysis. With flow 
cytometry, mass tests are performed in gross on a spec- 
imen cell population without a researcher being able to 
exclude or include certain data of the population. The 
specimen is measured "as is" without really knowing 
what cells are being measured and how many. Impor- 
tant single ceil data or data from relatively small groups 
of cells are lost in the overall averaging of a specimen. 
Further, relatively large amounts of a specimen have to 
be used to provide a required level of accuracy. Again, 
small changes in individual cells or small cell popula- 
tions cannot be discerned. 

Commercially available general purpose flow 
cytometers are very expensive and can handle only liq- 
uid blood specimens or tissue disaggregated speci- 
mens. Additionally, flow cytometers are incapable of 
working on standard tissue sections or using conven- 
tional microscope slides which are the preferred speci- 
men forms of pathology laboratories. 

Although the automation of cell analysis using 
microscope slide cell samples is exceedingly difficult 
such has been automated to a human-machine interac- 
tive level. One such method and apparatus is described 
in United States Patent No. 4,471,043 to Bacus, for 
Method And Apparatus For Image Analysis of Biological 
Specimens. Cell samples are attached to slides and an 
operator adjusts the system optics to view desired 
image fields of the cell sample. The operator then 
selects and classifies particular cell objects of the sam- 
ple. After such operator action, the automated equip- 
ment quantitatively measures particular attributes of the 
selected and classified cell objects and records a digital 
representation of the optical image. The measured 
attributes can be reported on a per object basis or on an 


accumulated basis, and the stored image representa- 
tions can later be read form memory for review. 

Heretofore, slides prepared for use in image analy- 
sis often have different areas widely spaced on the slide 
at which different actions or functions are to be per- 
formed. For instance, a slide may have a clear area 
thereon which is selected for use in adjusting or calibrat- 
ing the light and color levels needed for analysis of 
specimens located on the slide in another area of the 
slide. The operator may want to adjust the light level for 
each slide or for a group of slides in a slide tray or car- 
rier. Also, the specimen celts may be located in a small 
portion of a specimen area on the slide and considera- 
ble time would be saved if the carrier positioned the 
slide specimen with this small portion of specimens 
directly beneath the microscope rather than having to 
examine large empty areas before locating the small 
specimen. Likewise, a calibration specimen in a calibra- 
tion area may take a long time to locate by the machine 
because of the large empty area about the specimen. 
Still iaother slides such as blood slides, the blood sam- 
ple may cover the entire slide leaving no dear area for 
light setting. 

The slides can be searched by the analysis appara- 
tus to find particular areas, such as specimen or cali- 
brate areas, however, doing so with a for example, 40x 
objective used for analysis, is difficult and time-consum- 
ing. The image area of a high power objective is only on 
the order of 20 by 20 microns so that each step in a 
search routine is very short and many such steps must 
be performed. Further, the depth of field with a high 
power objective is very short and refocusing must occur 
at each image field. When a clear, area is under the 
slide, as will be the case for most of a search for small 
samples, much time is wasted trying to focus on non- 
existent objects. It is a significant problem in an auto- 
mated analysis to be able to locate a small area or a 
specimen on a slide and to perform a desired function 
on each of a plurality of areas on the slides in a carrier 
in a fast and efficient manner. 

ft is an object of the invention to provide an 
improved slide viewing apparatus. 

This object is solved, according to the invention, by 
the apparatus of claim 1 . 

An operator views a grid projected on the slide and 
designates the grid section having the specimen and 
such designation causes the grid section and specimen 
to be shown in enlarged size, e.g. , 4x or 1 0x on a moni- 
tor screen. The mark noted by the operator may have 
been placed there by the pathologist at earlier time or 
the mark may be made by operator moving a mark 
along the monitor screen to a position adjacent the 
specimen while it is being viewed. In either event the 
operator enters the address of the mark as the location 
to begin the scanning operation for the specimen. The 
preferred apparatus includes a flat bed carrier having a 
plurality of slides therein and the operator prepares 
each slide usually with several addresses and a specific 
function for the address such as focus, scan, analyze, 
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eta There may be more than one operator and more 
than one station that is pre-screening the slides interac- 
tively and the slides in their respective carriers are 
transferred to the automatic image analysis machine 
which automatically steps the flat bed carrier or a car- $ 
rousel-type carrier to quickly move each slide through 
the various functions needed to perform the analysis. 

FIG. 1 is a perspective view of an apparatus for 
assaying biological specimens; 
FIG. 1 A is a perspective view, having portions bro- 
ken away, of an automatic optical input subsystem 
of the apparatus for assaying biological specimens 
shown in FIG. 1; 

FIG. 2 is a block diagram of the apparatus shown in 
FIG.1; 

FIG. 3 shows a slide holder and associated control 
equipment of the apparatus shown in FIG. 1 ; 
FIG. 4 is a block diagram view of focus and light 
control portions of the apparatus shown in FIG. 1 ; 
FIG. 5 is a plan view of a tissue section microscope 
slide for use with the apparatus of FIG: 1 ; 
FIG. 6 is a graphical representation of the optical 
properties employed in biological specimen assay; 
FIGS. 7 and 8 are schematic views of the biological 
specimen preparation prior to assay; 
FIGS. 9 and 10 are flow diagrams of the control pro- 
cedures invoked in the assay of a plurality of biolog- 
ical specimens; 

FIG. 11 represents an image field of an optically 
unfiitered tissue section; 

FIG. 12 represents the image field of FIG. 1 1 when 
optically filtered by a red filter having a passband 
centered about 620 nanometers; 
FIG. 13 represents the image field of FIG. 1 1 when 
optically filtered by a green filter having a passband 
centered about 500 nanometers; 
FIG. 14a is a template for use in identifying slide 
action points; 

FIG. 14b is a representation of a slide tray in which 
the template of FIG. 1 4a is visible; 
FIG. 15 shows the apparatus operations available 
from a tray setup function of the apparatus; 
FIG. 16 is a visual image presented to an operator 
during the tray setup functions; 
FIG. 17 shows a data file established during tray 
setup; 

FIG. 18 is a flow diagram of a setup scan routine; 
FIG.1 9 shows a monitor screen displayed during 
tray setup; 

FIG. 20 shows a monitor screen displayed during a 
setup scan routine; 

FIG. 21 is a flow diagram of analysis by the appara- 
tus after slide locations have been selected; 
FIG. 22 is a flow diagram of operations performed 
to resolve joystick actions; and 
FIG. 23 is a flow diagram of a scan routine. 

The embodiment disclosed herein is used for the 


assay or quantitation of biological specimens specifi- 
cally estrogen and progesterone in tissue samples. The 
tissue sample staining and measuring techniques for 
the estrogen/progesterone assay are described in detail 
in United States Patent No. 5,008,185. 

The tissue sample assay is performed using a two- 
color optical system to enhance the optical characteris- 
tics of stained tissue samples. It will be apparent to 
those skilled in the art that many inventive features of 
the disclosed embodiment may be employed for other 
types of cell analysis e.g., DNA quantification and that 
other types of optical apparatus e.g., single color could 
be employed. 

An apparatus for assaying biological specimens, 
and generally identified by numeral 10 is shown in per- 
spective view in FIG. 1 and in block diagram form in FIG. 
2. The apparatus 10 comprises an interactive optical 
input system 11a primarily for use in low power scan- 
ning of microscope slides of biological specimens to 
select fields for later analysis. An automated assay 
processing system 11b also comprises a portion of the 
apparatus for scanning up to eight slides at once at rel- 
atively high magnification for performing biological 
assays on the slide. A processor system 32 receives 
signals from the optical units for later image processing. 

The interactive optical system 11a comprises an 
optical microscope 12, which may be of any conven- 
tional type, but in this embodiment is a Riechart Dias- 
tar. An optical conversion module 14 is mounted on the 
microscope 12 to enhance the optically magnified 
image of cell samples viewed with the microscope 12. 
The optical conversion module 1 4, as may best be seen 
in FIG. 2, includes a beam-splitting prism 80 which con- 
veys approximately 90% of the light into optical conver- 
sion module 14 and passes the remaining 10% to a 
microscope eyepiece 76. The light transmitted into mod- 
ule 1 4 is fed to a dichroic beam-splitter 82 which reflects 
a portion of the light to a television camera 20 via a red 
filter 18 and a mirror 81. The remaining portion of the 
light is filtered by a dichroic beam-splitter 82 and fed to 
a television camera 26 through a green filter 24. The 
dichroic beam-splitter 82 selectively passes light having 
wavelengths greater than approximately 560 nanome- 
ters to the filter 1 8 and having a wavelength of less than 
560 nanometers to the filter 24. Thus, the dichroic 
beam-splitter 82 acts as a first color f flter before the light 
reaches the color filters 1 8 and 24. Red filter 1 8 is a 620 
± 20 nanometer bandpass optical transmission filter 
which provides a high contrast image to the camera 20. 
As shown in FIG. 2, the camera 20 then generates an 
NTSC image signal which is fed through an optical sig- 
nal switch 90a to an image processor 90 of an image 
processor module 28 (FIG. 2). Green filter 24 is a 500 ± 
20 nanometer narrow bandpass optical transmission fil- 
ter which provides a high contrast image to a camera 
26. The camera 26 then feeds an NTSC image signal 
through the optical signal switch 90a to an image proc- 
essor 92. Both of the image processors 90 and 92 con- 
tain analog to digital converters for converting the 
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analog NTSC signals to a digitized 384 by 485 array 
pixel image. The center 256 by 256 array of pixels from 
this digitised image is then stored within frame buffers 
internal to the image processors 90 and 92. The visual 
image represented by the 256 by 256 array of pixels is 
referred to as an image field. 

During assembly of the apparatus of FIG. 1, and 
from time to time thereafter, if necessary, the optical ele- 
ments of conversion module 14 are adjusted so that 
each camera 20 and 26 receives the same optical 
image and each pixel of the digitized pixel arrays pro- 
duced by processors 90 and 92, presents the same 
region of a viewed optical field. 

Each of the image processors 90 and 92 is a Model 
AT428 from the Data Cube Corporation, and includes 
six internal frame buffers. The image processors 90 and 
92 are connected to a system bus 34 of a computer 32. 
The frame buffers of image processors 90 and 92 are 
mapped into the address space of a microprocessor 36 
in computer 32 to provide easy access for image 
processing. Additionally, an image monitor 30 is con- 
nected to image processor 92 and displays a cell sam- 
ple image field stored in a predetermined one of the 
frame buffers. The storage of an image field representa- 
tion into the. predetermined frame buffer is described 
later herein. 

. The automatic optical conversion module 11b, as 
may best be seen in FIG. 2, includes a prism 80a which 
conveys the light into optical conversion module 14a. 
The light transmitted into module 1 4a is fed to a dichroic 
beam-splitter 82a which reflects a portion of the light to 
a television camera 20a via a red filter 18a and a mirror 
81a. The remaining portion of the light is filtered by a 
dichroic beam-splitter 82a and. fed to a television cam- 
era 26a through a green filter 24a. The dichroic beam- 
splitter 82a selectively passes light having wavelengths 
greater than approximately 560 nanometers to the filter 
18a and having.a wavelength of less than 560 nanome- 
ters to the fBter 24a. Thus, the dichroic beam-splitter 
82a acts as a first color filter before the light reaches the 
color filters 18a and 24a. Red filter 18a is a 620 ± 20 
nanometer bandpass optical transmission filter which 
provides a high contrast image to the camera 20a. As 
shown in FIG. 2, the camera 20a then generates an 
NTSC image signal which is fed through the optical sig- 
nal switch 90 to the image processor 90 of the image 
processor module 28 (FIG. 2). Green filter 24a is a 500 
± 20 nanometer narrow bandpass optical transmission 
filter which provides a high contrast image to a camera 
26a. The camera 26a then feeds an NTSC image signal 
through the optical signal switch 90a to the image proc- 
essor 92. 

The microprocessor 36 of computer 32 is an Intel 
80486 microprocessor which is connected to the sys- 
tem bus 34. The optical switch 90a, under control of the 
microprocessor 36, selects the signal from interactive 
unit 11a or automatic unit 11b to be fed to the image 
processors 90 and 92. A random access memory 38 
and a read only memory 40 are also connected to the 


system bus 34 for storage of program and data. A disk 
controller 42 is connected by a local bus 44 to a Win- 
chester disk drive 46 and to a floppy disk drive 48 for 
secondary information storage. Advantageously, local 

5 bus 44 is connected to a moveable media bulk data 
drive 45 such as an optical write once read many times 
(WORM) drive for image field recording and retrieval. 

A video conversion board 50, in this embodiment a 
VGA board, is connected to the system bus 34 to control 

10 an instruction monitor 52 connected to the VGA board 
50. Operational information such as selection menus 
and reports of analysis are displayed on instruction 
monitor 52. A keyboard processor 54 is connected to 
the system bus 34 to interpret signals from a keyboard 

is 56 connected to the keyboard processor 54. Input sig- 
nals to microprocessor 36 are also generated by a hand 
control drive (mouse) 13 having a control button 15. Sig- 
nals from mouse 13 and its button 15 are conveyed to 
bus 34 via a mouse interface 17. A printer 58 is con- 

20 nected to the system bus 34 for communication with 
microprocessor 36. The apparatus 10 also includes a 
joystick control device 13a of a type well known in the 
art. Signals from the joystick 13a are conveyed to bus 
34 via a joystick interface 17a. 

25 The automated image input subsystem 11b of 
apparatus 1 0 performs automated X-Y slide positioning, 
image focusing, light intensity adjustment and light color 
balancing functions. The X-Y slide position controlling 
apparatus is shown in FIGS. 1. 1A, 3 and 4, and 

30 includes a slide holder 62a capable of holding eight 
microscope slides 101 through 108 in side-by-side rela- 
tionship such that the upper surfaces of the slides are 
substantially coplanar. Slide holder 62a, which is some- 
times referred to as a flat bed carrier, is movably 

35 attached to the stage 65a of microscope objective 64a 
by means of a slide holder base 63a. The portion of 
slide holder 62a position able with respect to microscope 
objective 64a is controlled by an X position stepper 
motor 110 and a Y position stepper motor 1 1 1 which are 

40 mechanically attached to base 63a The stepper motors 
110 and 111 are of the type known in the art which 
respond to pulse signals from a slide holder position 
controller 60. The actual X and Y positions of the slide 
holder 62a are sensed by an X position sensor 68 and a 

45 Y position sensor 66, respectively, which substantially 
continuously report position information to slide holder 
controller 60. In the present embodiment the slide 
holder 62a, base 63a, and position sensors 66 and 68 
including limit switches and numbered 110 and 111 

so comprise a commercially available unit from 
Marzhauser Wetzlar GmbH Model EK8B-S4 with Model 
MCL-3 control units. 

Responsive to appropriate stepper motor control 
signals, the slide holder base 63a is capable of placing 

55 substantially all of each of slides 1 01 through 1 08 under 
the objective 64a. Slide holder position controller 60 is 
connected to system bus 34 by means of a communica- 
tion path 61. Microprocessor 36, as discussed later 
herein, transmits commands to slide holder position 
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controller 60 specifying an X and Y position to place 
under the microscope objective 64a. Slide holder posi- 
tion controller 60 responds to such commands by trans- 
mitting to the X and Y stepper motors 1 10 and 1 1 1 the 
appropriate sets of pulse signals to move the slide 5 
holder 62a to the desired X-Y position. The actual posi- 
tion of slide holder 62a is checked by slide holder posi- 
tion controller 60 during and at the completion of 
movement. The slide holder position controller 60 also 
maintains an internal record of the X and Y position of 
the slide holder 62a which internal record can be read 
by microprocessor 36 via bus 34 and communication 
path 61. 

The apparatus 10 also includes a focus and light 
controller 73 which controls the light intensity and color 
balance from the light source 84a, as well as the focus 
of the image field presented to microscope 12. Micro- 
processor 36 communicates with focus and light con- 
troller 73, via the system bus 34 and a communication 
path 74, to control the focus and light properties. FIG. 4 
is a functional block diagram of focus and light controller 
73 and its connection to objective 64a and to bus 34. 
The objective 64a includes a focus stepper motor 75a, 
which is controlled by focus and light controller 73 . 
through the stepper motor controller 73a to raise and 
lower the stage 62a, and thereby raise and lower the 
microscope slides 101 through 108 carried by slide 
holder 62a. Microprocessor 36 includes a focus routine 
which is periodically performed during tissue analysis. 
When the focus routine is entered, microprocessor 36 
reviews a digital representation of an image field, from 
the image processors 90 and 92, and issues a com- 
mand to focus and light controller 73, to raise or. lower 
the stage by a specified amount. Focus and light con- 
troller 73 responsiveiy transmits to focus stepper motor 
75a electrical signals to implement the requested stage . 
movement. By continued checking of the quality of the 
image field and adjustment of the up and down position 
of the slide holder 62a, microprocessor 36 brings the 
upper surface of the slide under the objective 64a into 
focus. 

Microprocessor 36 also stores a target value for the 
light intensity which is to be maintained during tissue 
sample analysis. This stored light intensity value is used 
by microprocessor 36 in conjunction with an intensity 
function to regulate the intensity of light from light 
source 84a. When the intensity function of microproces- 
sor 36 is enabled, the light intensity as represented by 
image fields from image processors 90 and 92 is deter- 
mined. Any departure from the stored target light inten- 
sity value is corrected by sending intensity control 
commands to focus and light controller 73 which 
responds thereto by controlling a voltage regulator to 
increase or decrease the voltage applied to light source 
84a. Voltage regulator 83 may be, for example, a stand- 
ard rotatable voltage regulator which is rotated by a 
stepper motor operating under the control of electrical 
signals from focus and light controller 73. 

The analysis performed in the present embodiment 


relies on a two-color system. For accuracy of measure- 
ment, it is important that the two-colors observed by 
cameras 20 and 26 be of substantially the same inten- 
sity. The microprocessor 36 includes a color balance 
function, which is called to match the intensities of the 
red and green colors applied to cameras 20 and 26 by 
light source 84. Objective 64a has associated with it a 
condenser 85a, which is controlled by a stepper motor 
86a, electrically connected to focus and light controller 
73. When in the color balance function, microprocessor 
senses color imbalance by comparing the image field of 
image processor 90 with that of image processor 92. 
Microprocessor 36 sends color balance adjustment 
commands to focus and light controller 73 in response 
to color imbalance and through a process of repeated 
comparison and color balance adjustment commands 
achieves a color balance suitable for tissue sample 
analysis. 

FIG. 5 shows a representation slide e.g., 102 which 
has been prepared for analysis in accordance with the 
embodiment The slide 102 includes a dark line outline 
87 of a rectangle near one end thereof. The rectangle 
87, which is printed in substantially the same position 
on all slides is used during focus and light adjustment 
routines and during slide preparation to identify the 
placement of tissue samples. 

A method of quantitating nuclear proteins of the 
present embodiment includes providing specimen 88 
cell objects on slide 102 and staining them with an opti- 
cal enhancement factor which specifically binds to the 
nuclear protein. The stain is then viewed with the image 
analysis system 10 to measure the optical density of the 
stain for intensity measurement and to locate the areas 
in which stain is found for distribution measurement. 
Because the intensity of the staining relates to the quan- 
tity of the nuclear proteins, measurement of the different 
optical densities of the stain permits a direct measure- 
ment of the quantity of the proteins. In the preferred 
embodiment control cell objects 89 are placed on a ref- 
erence section of the slide 102 to provide a normaliza- 
tion or reference optical density for the staining. Further, 
one or several courrterstains can be used to further dis- 
tinguish among several features of the cell objects. 

No actual marks except rectangle 87 appear on the 
slides 101-108 to differentiate the control cell objects 89 
from the specimen 88. However, for automated location 
of points to begin analysis, the slide should be prepared 
such that the control cell objects 89 overlap the longitu- 
dinal center line of the slide (denoted by a dotted line 91 
in FIG. 5) and that the control cell objects 89 are closer 
to the rectangle 87 than is the specimen 88. Similarly, 
the specimen 88 should be positioned overlapping the 
longitudinal center line and farther from rectangle 87 
than the control cell objects 89. 

Preferably, the staining method employs a sensitive 
peroxidase antiperoxidase technique for visualization of 
estrogen or progesterone receptors in specimens 
through the use of monoclonal antibodies directed spe- 
cifically against those receptors. A diagrammatic repre- 
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sentation of the process on the microscopic level is 
illustrated in FIGS. 7 and 8. Two portions of a human 
tumor specimen containing a cell population from which 
the estrogen receptors are to be measured are placed 
on the two separate sections of the slide 1 4 and suitably 5 
fixed thereto as by tissue adhesive. The separate sec- 
tions are then fixed in separate washes of formalin, 
methanol and acetone, and thereafter, treated with a 
blocking reagent to prevent non-specific binding of the 
subsequent reagents. 10 

The part of the specimen cells 88 to be measured is 
incubated with a primary antibody, a monoclonal anti- 
body (rat) to human estrogen receptor in the specimen 
portion of the slide. This antibody, as represented at 
1 28, binds specifically to the estrogen receptor sites E R 15 
of this tissue portion. The reference portion 89 of the 
specimen is incubated with a control, normal rat IgG, 
represented at 1 30. The purpose of the control 1 30 is to 
evaluate the amount of binding of the immunoperoxi- 
dase reagents in this technique to nonspecific sites NS 20 
of the specimen to yield a background measurement 

Both tissue sections 88 and 89 on the slide 1 02 are 
then incubated with: a bridging antibody, an anti-rat 
immunoglobulin (goat) illustrated at 132 in both figures. 
The bridging antibody 132 binds to the rat antibody 128 25 
against human estrogen receptor in the specimen sec- 
tion 88 and to any bound normal rat IgG 130 in the con- 
trol section 89. 

A rat PAP complex 1 34 is added to both sections 88 
and 89 of the specimen and binds to the anti-rat IgG so 
bridging antibody at 132. After this step, a solution con- 
taining hydrogen peroxide and diaminobenzidine (DAB) 
and 4 N HCI is added to the specimen and control sec- 
. tions. The reaction of the peroxidase with hydrogen per- 
oxide converts the bound DAB present into an insoluble ss 
reddish brown precipitate. The proportion of the precip- 
itate and its location are influenced by the binding posi- 
tions of the PAP complex and, through the bridging and 
primary antibodies, the locations and amounts of the 
estrogen receptors in the specimen. ao 

The concentrations, timing, and chemical composi- 
tions of the reagents used in this staining method are 
more fully described in the aforementioned United 
States Patent No. 5,008,185. Preferably, the mono- 
clonal antibody which is used to bind to the estrogen 45 
receptor sites is one of those developed at the Univer- 
sity of Chicago and designated H222 sP2 and H226 
sP2, and that which is used to bind to the progesterone 
receptor is one which is commercially available from 
Transbio Sari 6 Rue Thiers, Paris France and desig- so 
nated mPRI. 

The DAB precipitate is then visualized by image 
analysis with apparatus 10 to determine the quantitation 
of the estrogen receptors in the specimen. In general, 
the brown precipitate does not transmit light well and ss 
will show up as dark areas in the cells of the specimen. 
The optical density and hence pixel intensity will be 
related directly to the amount of DAB precipitate and to 
the quantity of estrogen receptor which has bound the 


antibodies. To be able to more clearly visualize the 
nuclear area of each cell, a counterstain of methyl green 
is added. It is important to note that both the primary 
stain of DAB precipitate and the counterstain of methyl 
green are specific to the nucleus of each cell. This 
means that debris and other cellular features will appear 
lighter in the microscope image and can be distin- 
guished. 

A dual camera method is thereafter applied to dis- 
tinguish the areas stained by the DAB and the areas 
stained by the methyl green. The red and green filters 
18 and 24 respectively form monochromatic images of 
the cell objects at their respective cameras 20 and 26 
which images can be stored in the apparatus 10. These 
images, one by the red filter and the other by the green 
filter, are used to separate the primary stained areas 
from the nuclear areas, and to separate the nuclear 
areas from other cell or field features. 

The results and desirability of this dual filtering of a 
counterstained cell image are more fully illustrated in 
FIG. 6. The percentage of light transmitted through the 
nuclei stained with methyl green is shown in the curve A 
as a function of the wavelength of light The percentage 
of transmission of light for diaminobenzidine (DAB) is 
shown in curve B as a function of the wavelength of 
light. The bandwidth of wavelengths of light passed by 
the green filter is illustrated in band C while the band- 
width of wavelengths of light passed by the red filter is 
illustrated in band D. 

When an image of a counterstained cell population 
or specimen is filtered with the green filter 24, substan- 
tially all of the areas stained with the methyl green will 
be invisible. This is because the methyl green curve A 
has a relative transmissive peak near this wavelength 
band while the diaminobenzidine curve B is relatively 
non-transmissive in this band. Thus, the areas with pri- 
mary DAB stain can be separated from the nuclear 
areas. At the other extreme of the graph, the band D of 
the red filter is positioned at a place where just the 
opposite occurs. The methyl green curve A has a rela- 
tively non-transmissive valley in this bandwidth while the 
diaminobenzidine curve B is also relatively non-trans- 
missive. Thus, the nuclear areas containing both the pri- 
mary stain and the counterstain appear darker than 
other cell features and can be readily identified. 

Because of the relative differences in light transmis- 
sion between the primary and counterstain in the two fil- 
tered bandwidths, the methyl green stained area is 
enhanced during one filtering relative to other areas of 
the cell, and the areas which have diaminobenzidine 
precipitate are enhanced relative to the methyl green 
areas during the other filtering. Thus, the nuclear areas 
of the cell objects are optically enhanced along with the 
areas having DAB precipitate. 

FIG. 1 1 represents an optical image field of a tissue 
sample as presented to the microscope objective 64. In 
the image of FIG. 11, objects 200, 202 and 204 are 
green cell nuclei where nuclei 202 and 204 have brown 
areas 206 and 208 respectively of DAB precipitate. 
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Nucleus 200 does not contain any estrogen receptor 
and therefore, does not have any DAB precipitate. 
Objects 21 0, 212 and 214 are various other cell features 
or debris from the tissue section. FIG. 12 represents the 
image field presented by red filter 1 8 to camera 20 and 5 
its associated image processor 90. In FIG. 12, the 
nuclei 200, 202 and 204 stand out because of the coun- 
ter staining and filtering, while the DAB areas are not 
visible. FIG. 13 represents the image field presented by 
green filter 24, to camera 26 and its associated image 
processor 92. In FIG. 13, the estrogen receptor areas 
206 and 208 stand out so that their area and density can 
be readily measured. The dotted lines of FIG. 13 repre- 
sent the boundaries of nuclei 200, 202 and 204, which 
are shown for reference purposes. As previously dis- 
cussed, a monitor 30 is available for displaying image 
fields of the cell sample. When an image field is to be 
displayed, microprocessor 36 computes a composite 
image by summing the image field of image processor 
90 (of the type shown in FIG. 12). With the image field 
of image processor 92 (of the type shown in FIG. 13), 
the composite image is then stored by microprocessor 
36 in the predetermined frame buffer of image proces- 
sor 92 which is the source of images for monitor 30. 

While the implementation shows a convenient and 
advantageous method for discriminating between the 
two areas having counterstaining, it is recognized that 
there are various other staining or optical enhancement 
methods and filtering methods which can be used to 
optically enhance one particular area or feature over 
another cell feature. For the quantitation of the specific 
hormonal receptors shown (progesterone and estrogen 
receptors), what is important is to distinguish the 
nuclear area which contains receptors by the presence 
of the cGaminobenzidine precipitate. 

Up to eight slides mounted in a slide tray are ana- 
lyzed in an automatic analysis session. One of the eight 
slides (101) is a calibrate slide and the remaining seven 
slides are preferably prepared using tissue sections 
from the same tissue mass. The calibrate slide 101 is 
prepared in the same manner as all other slides, but the 
tissue sections used are taken from a standard tissue 
mass having known amounts of estrogen and proges- 
terone receptors. Preferably, all eight slides which are to 
be analyzed in the same session are fixed and stained 
in accordance with the above disclosed process as a 
batch, so that they all undergo substantially the same 
preparation. 

Upon completion of the fixing and staining of the 
slides 101 through 108, they are inserted into slide 
holder 62a which secures each slide at a predetermined 
position on the slide holder. In the present embodiment, 
calibration slide 101 is placed in the left most position 
and the slides 102 through 108 are distributed in any 
order in the remaining seven slide positions. All slides 
are oriented so that their printed rectangle 87 is at the 
bottom as shown in FIG. 3. The slide holder is then 
inserted into the slide holder base 63a with the printed 
rectangles away from microscope 12. After placement 


of the slide holder, the operator signals, by means of 
keyboard 56, that the analysis is to begin. 

A flow diagram of the automated analysis routine is 
shown in inter-related FIGS. 9 and 10. The routine 
begins at a step 136 with a request by the apparatus on 
instruction monitor 52 for patient labelling information. 
When patient labelling is completed by means of opera- 
tor interaction with the keyboard 56, the automated por- 
tion of the analysis procedure begins and the operator is 
free to go about other tasks. 

Initially, microprocessor 36 by means of control sig- 
nals sent over system bus 34 to the slide holder position 
controller 60, requests the movement of slide holder 
62a to its maximum X and Y positions, as represented 
by a point 120 in the upper left of slide 101 and a point 
121 in the lower right of slide 108. No actual marks 
appear on the slides to represent points 120 and 121, 
but these points are located by the maximum travel of 
the slide holder 62a. The X and Y values of points 120 
and 121 are read from position sensors 1 10 and 1 1 1 so 
that the position ranges of slide holder 62a are known 
by microprocessor 36. Since the slides 101 through 108 
are held in predetermined positions, microprocessor 36 
can easily compute the X address of the longitudinal 
center of each slide 101 through 108. and since the 
position of the rectangle 87 on each slide is also known 
the Y position of each rectangle 87 can be computed 
with reasonable accuracy. These slide reference posi- 
tions are calculated in step 140. The analysis routine 
next proceeds to step 142 in which the microprocessor 
36 requests movement of the slide holder 62 to position 
the near center of rectangle 87 of slide 101 under the 
objective 64a. 

The automated analysis routine of the present 
embodiment is performed using a single 40X objective 
which has a short depth of field on the order of a few 
microns. Although the slide holder and slides are rela- 
tively precise, they do not necessarily guarantee that 
the surface of the slides will always be at optimum focus 
when presented to the microscope objective 64a. 
Accordingly, as the analysis for each new slide begins, 
the apparatus is first focused using a line 79 of the slide 
rectangle 87. After the initial focus on line 79 is 
achieved, the apparatus is periodically refocused during 
analysis to provide accurate image fields. 

In a step 144, the slide 101 is moved so that the 
path of the objective travels along the imaginary center 
line 91 (FIG. 5) until line 79 is detected. Line 79 is of suf- 
ficient width and opacity that it is detectable even with a 
poorly focused objective. As the slide 1 01 moves, micro- 
processor 36 monitors the pixel array of image proces- 
sor 90 which represents the current image field 
presented to the objective. Microprocessor stops slide 
movement, when line 79 appears in the image field of 
image processor 90 and performs a focus routine on the 
inner edge of line 79. In the focus routine microproces- 
sor 36 successively analyses the sharpness of the 
image field from image processor 40 and adjusts the 
microscope stage to objective distance by means of 
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focus and light controller 73. When accurate focus is 
detected by microprocessor 36, the flow proceeds to 
block 126 in which the slide is moved back to a point 
within rectangle 87. The rectangle 87 is to be free from 
any tissue section or other contaminants. Accordingly, 5 
the light level and color balance can be adjusted by 
means described above while the presented image field 
is from within rectangle 87. 

After light level and color balance are established 
the routine proceeds to a step 150 in which the slide is 10 
moved to view successive image fields along the center 
line 91 in search of a first image field representing refer- 
ence tissue sample 89. The slide is moved so that the 
objective 64a traces a path represented by a search 
path line 94 shown in FIG. 5. Periodically slide motion is 75 
stopped, the objective 64a is focused by the microproc- 
essor 36 and the then current image field from image 
processor 90 is analyzed to determine if the control 
sample has been found. An image field of control sam- 
ple 89 will be identified in a step 152 as an image field 20 
possessing analysis value. An image field is determined 
in step 152 to possess analysis value when the area of 
the nuclear material in the image field from image proc- 
essor 90 exceeds a, predetermined threshold stored in , 
microprocessor 36. Microprocessor 36 analyzes each 25 
image field pixel array from image processor 90 which . 
arrays represent the nuclear image of the image fields. 
When the nuclear area of an image field exceeds the 
threshold stored in microprocessor 36, the image field 
has analysis value and the flow proceeds to step 154 30 
where attributes of the image field are; measured and 
recorded. * 

In step 154, the digitized image field from image 
processor 90 is analyzed to identify a nuclear boundary 
level value for the nuclear material in the field. The 35 
nuclear boundary level which will be used in quantita- 
tion of the specimen 88 is stored in memory 38. Also, in : 
step 154 microprocessor 36 measures the digitized 
image field from image processor 92 to identify an anti- 
body stain threshold. This threshold is necessary to 40 
determine the contribution of the non-specific staining 
of the control cells and the contribution of the counter- 
stain methyl green, to the total stain detected by the 
instrument. This antibody stain threshold permits the 
discrimination between antibody negative stain cells 45 
and antibody positive stain cells. After its determination, 
the antibody stain threshold level is stored in memory 
38. Upon completion of the measurement and recording 
of step 154, a step 156 is performed in which the digital 
image fields of both image processors 90 and 92 are so 
stored in memory. The digital image fields may advanta- 
geously be stored in bulk data drive 45. 

Trie search path 93 (FIG. 5) begins within rectangle 
87 and proceeds along center line 91 until a first image 
field having analysis value is detected at point 93. When 55 
microprocessor 36 detects the first control cell object 
image field, the search movement pattern, directed by 
microprocessor 36, changes the search movement pat- 
tern for image fields, as directed by microprocessor 36, 


follows a sweeping pattern back and forth across the 
control as represented in FIG. 5 by the line 94. While 
traversing the reference specimen 89 successive image 
fields of the specimen are analyzed and for each image 
field the possessing analysis value, the nuclear bound- 
ary level and the antibody stain threshold are updated. 
Also, both digital images of each image field found to 
possess analysis value are stored in memory. Image 
fields continue to be analyzed from control specimen 89 
until the total nuclear area of the image fields of analysis 
value exceeds 5,000 square microns. When the 5,000 
square micron threshold is detected in step 158, slide 
holder movement is directed to return the objective 64 
to center line 91 and to proceed downwardly (step 160) 
until a first specimen image field is detected at point 96 
of FIG. 5. In a manner similar to step 152, the image 
field having analysis value is identified in step 164 of the 
flow diagram (FIG. 10) based on the nuclear area con- 
tained by the image field. 

When step 1 64 finds an image field having analysis 
value, the flow proceeds to step 166 where attributes of 
the specimen image field are measured and recorded. 
The attributes measured and recorded in step 1 66 com- 
prise the optical density of DAB areas 206 and 208, the 
visible area of DAB areas 206 and 208 and a compari- 
1 son of the total nuclear area in the image field with the 
area of DAB areas 206 and 208. After measuring and 
recording image field attrtoutes in step 1 66, the digitized 
representations of the image field are also stored in 
memory. In the present embodiment, the entirety of the 
specimen 88 is scanned by the apparatus as repre- 
sented by the line 94 (FIG. 5). The completion of scan- 
ning for tissue sample 88 is detected in step 170. 

When, as is the case in the present example, the 
recorded data relates to calibration slide 101, as is 
detected in step 171, calibration values are calculated 
and stored for later use in the analysis of measured 
attributes of other slides 1 02 through 1 08. After the stor- 
age of the calibrate values in step 173, the flow pro- 
ceeds to a step 1 72 to determine if all slides have been 
analyzed in step 172. Since in the present example, 
they have not the slide holder is moved to position the 
objective in the rectangle 87 of the next slide in the slide 
set, which is slide 102. In the present example, slides 
102 through 108 will be analyzed in sequence in the 
same manner as calibrate slide 101, except that the 
data measured in their specimen portions 88 is not 
stored as calibrate data but as analysis results. 

When the last slide 108 has been completely ana- 
lyzed, the flow diagram of FIGS. 9 and 10 is terminated 
and the accumulated analysis result data is available for 
reports as described in detail in the aforementioned 
United States Patent No. 5,008,185. 

In the preceding embodiment, the cell samples 
were automatically located by the apparatus during an 
analysis operation. In order to speed analysis times, the 
apparatus 10 can be used to preselect points on the 
slide where analysis is to occur. The apparatus 10 
includes the interactive optical means 11a which com- 
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prises the microscope 12 having multiple turret objec- 
tives including a low power objective. The microscope 
12 has mounted thereon a manually operable stage for 
carrying a microscope slide having a biological speci- 
men thereon. The manually operable stage may be $ 
manipulated by the operator to bring various portions of 
the slide under the low power microscope objective. 
When the operator finds a region of interest that region 
is located by the position sensors 12a which are dis- 
closed in U.S. Patent No. 5,018,209 and maybe marked 
by a press of a button 1 5 on the mouse, keyboard or the 
like to signal the processor means that the coordinates 
of that field are to be stored so that the field may later be 
examined at high power by the automatic optical means 
1 1b. Thus, the slide may be quickly and rapidly scanned 
manually at low power selecting the portions of interest 
and then loaded into the slide rack 62a with other slides 
for examination at high power by objective 64a using the 
high speed automatic processing as set forth previously. 
The low magnification scan of interactive system 11a 
allows empty fields and fields which are not of interest to 
be avoided to reduce the amount of time consumed by 
the automatic optical means 11 b. The system 1 0 there- 
fore provides the advantage of the combination of inter- 
active, rapid, low . power scanning and storage of 
coordinates with high ; power automatic assay for full 
diagnostic treatment of the biological specimen. 

Further, after the high power assay has been com- 
pleted, the images may be called up from the WORM 
drive 45 tor additional editing or for deletion from 
assays, statistics and the like. Thus, the system allows 
pre-assay editing of the fields by the use of the low 
power microscope and post-assay editing of the fields 
with re-assaying by calling up the images from the 
WORM drive 45. 

In the preceding description, the tray of slides 62a 
could be placed in the automatic optical apparatus 116 
and the individual slides, e.g., 101, would be searched 
for calibrate and specimen samples, which samples 
would be appropriately analyzed. Additionally, the slides 
could be previewed under a low power microscope 12 
and locations of analysis interest entered directly into 
the analysis apparatus 10 to identify the starting points 
of analysis functions. 

Another method and apparatus can also be 45 
employed to identify search locations on microscope 
slides. This method and apparatus, which is described 
in detail below, permits the selection of a plurality of 
search locations, called action points, on each of the 
plurality of slides in a slide tray, e.g., 62a, and permits so 
the operator to specify an action e.g., scan or set light, 
at each selected action point. The action points and 
associated actions are easily selected interactively with 
the analysis apparatus 10 in preparation for an analysis 
session. Advantageously, the action points and associ- ss 
ated actions can be selected on other ancillary appara- 
tus and a data file representing such selections can be 
prepared. When analysis is to occur, the slide tray is 
loaded into the automatic optical apparatus 1 1b and a 


corresponding data ffle is entered into the analysis 
apparatus 10 by moveable storage means (diskette) or 
electronic communication. 

The selection of action points begins after at least 
one slide is mounted in a slide carrier (slide tray) 62a 
and involves visual inspection of the slides by an opera- 
tor and entry of information by that operator into the 
computer 32 by means of keyboard 56 and mouse 13. 
When the slides have been loaded into the slide tray 
62a, the tray is placed over a coordinate grid-forming 
template 251 as shown in FIG. 14a and a tray setup 
function 250 (FIG. 15) is initiated on the analysis appa- 
ratus 10. FIG. 14b shows a slide tray 62a held so that 
the coordinate grid of the template 251 is formed on the 
slides. The template 251 and slide tray 62a may be held 
in position by an appropriate jig (not shown). In the 
present embodiment, the slide tray 62a is positioned 
over the gridded template which is viewed through the 
slides. Other methods of forming a grid reference on the 
slides could be used, such as projecting the grid on the 
slides by optic means or viewing the slides through a 
clear gridded template. 

The tray setup function includes operator reviewing 
of its actual slides 101 through 108, a determination of 
the locations of points of interest (action points) on the 
slides from the coordinate pattern and the entry into 
apparatus 10 of information defining the points of inter- 
est. The tray setup function 250 begins with a. visual 
image 270 (FIG. 1 6) of a slide tray and slides 273 being 
displayed on instruction monitor 52. Also displayed on 
monitor 52 in the tray setup step function 250 is a tray 
setup menu 272, which identifies routines to be per- 
formed. The individual routines of menu 272 are 
selected by moving a cursor 271 by means of mouse 13 
and selecting a routine by pressing the button 15 when 
the cursor is on a routine. The selection of menu items 
by means of a mouse and cursor is well known in the 
art. The routines available in the tray setup function 250 
are also shown in flow diagram form in FIG. 15. 

Initially, the label tray routine 252- is entered to 
establish the identity of the slide tray being set up for 
analysis. In the label tray routine 252, the instruction 
monitor displays a window shown at 253 of FIG. 15, 
requesting entry by the operator of a pre-assigned tray 
identity number and a pre-assigned operator number. 
Upon exiting from the label tray routine by operator 
selection, the routine returns to the tray setup function 
250 and establishes a tray data file 280 (FIG. 1 7) for the 
identified tray. The data file 280 is stored in RAM 38 at a 
location identified by the tray identity number. The tray 
data fOe 280 includes a tray header 281 which stores 
both the tray identity number and the operator identity 
number as entered by the operator. 

After the flow returns to the tray setup function 250, 
the operator selects the label slide routine 255. In the 
label slide routine 255. the operator selects from the dis- 
played slide tray one of the slide images 273 which cor- 
responds to an actual slide in the slide tray being set up. 
The slide image 273 is selected by the mouse 13 and 
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cursor 271. Upon selecting a slide image, a prompt 
appears on monitor 52 for operator entry of the type of 
slide being set up, the patient number for the slide and 
the accession number. The prompt is represented at 
step 257 in FIG. 15. The slide types are shown at 274 in 
FIG. 16. When the data requested in step 257 has been 
entered, the routine returns to the tray setup function 
250 which stores the entered data in a slide header 282 
of data structure 280 (FIG. 17). The label slide routine 
255 can be used to identify all 8 slides in the tray which 
resulting in the storage of 8 slide headers, each associ- 
ated with one slide 101-108. In FIG. 16, the actual slide 
numbers from slides 101-108 have been written in 
parenthesis on slides 273 to show the correspondence 
between actual slides and slide images. 

After the slide images 273 have been labelled in 
routine 255. the operator selects the setup scan routine 
258 from menu 272. The setup scan routine allows the 
operator to identify action points on the slides and to 
define an action to be performed at each identified 
action point. A flow diagram of the setup scan routine 
258 is shown in FIG: 18. In the setup scan routine 258. 
the operator first selects a slide- image 273 by cursor 
271 movement. When a slide image -273 has been 
selected (step 300), the flow proceeds to a step 301 
where the identity of the actual slide 1 03 corresponding 
to the selected slide image is read. Next, a step 302 is . 
performed in which a slide grid 276 (FIG. 19), is dis- 
played on monitor 52. Slide grid 276 is an enlarged 
image of the selected slide image and includes a refer- 
ence grid pattern of four columns labelled A through D 
and nine rows, labelled 1 through 9. The rectangles rep- 
resented in slide grid 276 correspond to the pattern of 
reference rectangles formed on the actual slides in the 
slide tray 62a, as shown in FIG 14b. When the operator 
wants to specify a particular point on the actual slide for 
analysis or other action, he or she selects the rectangle 
on slide grid 276 which includes the particular point. 
Since the grid rectangles on the slide grid 276 corre- 
spond to the reference rectangles formed on the slides 
held in the slide holder (FIG. 14b). the identification of a 
rectangle of interest on slide grid 276 is a relatively sim- 
ple task 

As represented in FIG. 14b, a portion of a cell sam- 
ple is present in rectangle B-1 of slide 103. Accordingly, 
the operator moves cursor 271 to the rectangle B-1 of 
slide grid 276 on monitor 52 and presses button 15 to 
select rectangle B-1. The rectangle position is read by 
the apparatus 10 at step 303 (FIG. 18) and the flow pro- 
ceeds to a step 304, where a large grid 277 and an 
action menu 278 are displayed on monitor 52. Large 
grid 277 represents the selected rectangle B-1 of slide 
grid 276, and allows precise positioning of an action 
point within the selected rectangle. The large grid 277 is 
sub-divided into, for example, 100 horizontal (X) by 100 
vertical (Y) coordinate positions one of which can be 
selected by moving the tip of cursor 271 thereto and 
pressing mouse button 15. A dot 279 is shown in the 
Ipwer left-hand quadrant of large grid 277 to represent a 


selected point in cell sample 263. The X, Y coordinate 
position of point 279 in large grid 277 is read by the 
apparatus in step 305. since the position of rectangle B- 
1 on the slide is predetermined and its position of point 

5 279 within rectangle B-1 is now known, the absolute X. 
Y coordinate of the point on the slide is computed and 
stored in step 306. 

Each action point selected is associated with one of 
the actions listed in menu 278. Accordingly, the operator 

10 next moves the cursor to menu 278 to select one of the 
menu items. The selected action which is identified in 
step 307 is used in a manner described below to control 
apparatus 10 during the analysis of the slides on the 
side tray. That is, after all slides have been appropri- 

75 ately "marked" with action points, each associated with 
an action, the slide tray is mounted in automated assay 
apparatus 11b as shown in FIGS. 1 and 1a and the 
apparatus 10 implements the specified actions at the 
specified action points. It is important to note that the 

20 actions do not take place when selected but are 
recorded in a data file, e.g., 280, for use after the slide 
tray 62a is placed in assay apparatus 11b. 

The following briefly describes the actions listed in 
menu 278 of FIG. 19. The show field action will cause 

25 the apparatus 1 1 b to align the specified action point with 
objective lens 64a and display a focused image field of 
the action point on image monitor 30. The joystick action 
will cause the apparatus to align the specified action 
point with the objective lens 64a and to release the con- 

30 trol of the alignment between the objective 64a and the 
microscope slide to the operator, through joystick 13a 
manipulation. The set and check light actions also 
cause the apparatus to properly align the specified 
action point with the objective lens 64a, at which point 

35 light levels can be set or checked respectively, as previ- 
ously discussed. The scan action will cause the align- 
ment of the microscope objective 64a and the selected 
action point on a microscope slide and then begin to 
measure the attributes of a sample on the microscope 

40 slide. In the present embodiment, the scan action 
requires additional information to define the measure- 
ments to be made and how the scan is to be performed. 
The accumulation of such additional information is 
described later herein. 

45 A step 308 (FIG. 18) is performed to detect the 
selection of both an action point and its associated 
action. Subsequently, a check 309 is made to determine 
if the selected action is a scan action. Row proceeds to 
step 31 1 , when the selected action is not a scan action. 

so In step 3 11 , a dot 279 is displayed on monitor 52 image 
270 to indicate the position of the newly selected action 
point Next, a step 312 is performed to store in data file 
280 the accumulated data, called a position record, 
identifying the coordinate address of the action point 

55 and its associated action. For non-scan actions, the 
position record comprises data representing the loca- 
tion of the selected action point and the associated 
action. The position record is stored in association with 
the slide header, e.g., 282 of the slide identified in step 
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301 . In data file 280 (FIG. 1 7), the position records 283, 
284 and 285 associated with slide 1 01 are shown occu- 
pying memory locations subsequent to the slide 101 
header 282. It should be noted the other forms of asso- 
ciation such as linking or address translation tables 5 
could be used to associate slide headers with their 
associated position records. Advantageously, multiple 
position records can be associated with the same slide. 

When the performance of step 309 detects that a 
scan action has been selected, the flow moves to step 10 
313 in which a scan criteria menu 279 (FIG. 20) is dis- 
played on instruction monitor 52. The scan criteria 
menu 279 in conjunction with mouse and keyboard 
manipulation by the operator, defines the parameters of 
the scan to be performed at a previously selected action 75 
point. The scan type menu item 286 can be selected to 
set the scan-type to raster (as shown), horizontal or ver- 
tical. Raster scanning is a zig-zag pattern, as shown in 
FIG. 5, horizontal scanning consists of a straight line 
across the slide and vertical scanning consists of a 20 
straight line along the slide length. The X and Y step 
rate menu items 288 and 289 can be selected and set to 
define the spacing between evaluated image fields. 
Similarly, the definitions of blank fields and good fields 
(fields of analysis value) can be established by selecting 25 
and setting menu items 290 and 291. 

The sample type.menu item 293, allows the opera- 
tor to specify whether the sample being evaluated is a \ 
specimen or a calibration sample. Specifying the sam- 
ple type identifies how the measured cell object 30 
attributes in the image fields are to be evaluated when 
the slide is later analyzed in the apparatus 11b. The 
scan criteria menu 279 also includes a settaWe value 
295 to identify the end of a scan line. As shown in menu 
279, an end of line has been set to occur when three 35 
consecutive blank image fields are viewed. Menu 279 
also includes a settable value 296 which terminates a 
raster scan at a preset number of zig-zags and a setta- 
ble value 297 which terminates a scan when a set 
number of image f ields have been analyzed. 40 

After the scan criteria have been set using the scan 
criteria menu 279, the operator exits from the menu and 
the apparatus reads, at step 314, the established scan 
criteria values. From step 314, flow proceeds to block 
31 1 where the action points are displayed on the slide as 
tray image 270, as previously described. Row proceeds 
through step 312, in which the position record is stored 
in data file 280, to the select slide step 300. It should be 
mentioned that for scan actions, the position record 
stored in data file 280 includes the scan defining criteria so 
established in menu 279 in addition to the action point 
coordinates and specified action, e.g., scan. At the con- 
clusion of the setup scan routine 258, flow returns to the 
tray setup function 250 of FIG. 15. 

Four additional routines are available from the tray 55 
setup function 250. A load setup routine 259 responds 
to the operator entry (step 260) of a slide tray identity, 
for which a data file was previously created, by reading 
(step 261) the identified slide tray data file. A save setup 


routine 262 commits a just-prepared data file 280 to a 
more secure memory storage, for example, into disk 
storage. A dear setup routine 264 permits the clearing 
of the most recently created setup data file before it is 
committed to the more secure storage. A delete setup 
routine 263 enables the deletion of an identified data file 
from the more secure memory area. 

After the completion of the slide tray setup function 
250, a slide tray data file 280 as represented in FIG. 1 7 
exists in memory. The slide tray data file 280 is accessi- 
ble by its tray identity number and includes data repre- 
sentations of one or more action points, each in 
association with one of the described actions. 

FIG. 21 is a f taw diagram of the steps performed by 
apparatus 10 in the analysis of biological specimens 
mounted on the slides of the identified slide tray. The 
preceding actions establish a data file 280 identifying 
action points and actions for a slide tray identified by an 
identity number. When the slide tray is to be analyzed, it 
is loaded into automated assay processing system 11b 
of apparatus 10 and the slide tray identity of the loaded 
slide tray is entered (step 320) at keyboard 56. Initially, 
the slide tray ranges are. found in step 322 and slide 
positions calculated in step 324 in the manner 
described above with regard to the flow diagram of FIG. 
9. Then, in response to the entered slide tray identity, 
the computer 32 retrieves (step 326) the slide tray data 
file identified by the slide tray identity entered in step 
320. Next, a step 327 is performed in which the position 
records of all slides are read from the slide tray data file 
280 and reviewed to identify all action points associated 
with joystick actions. The joystick actions are separated 
from the other actions because they involve continued 
operator activity. 

FIG. 22 is a flow diagram of the joystick completion 
routine 328. Initially, the slide tray is moved (step 329) 
by the automated assay system 1 1b to align the first joy- 
stick action point with the microscope objective 64a. 
After routine focusing, the image f ield at the action point 
is presented on display monitor 30 and the X-Y position 
control of the slide tray 62a is released to the joystick 
(step 330). While the joystick 13a is in slide position 
control, the computer 32 responds to joystick signals by 
controlling the assay processing system 11b to move 
the slide to positions determined by operator interaction 
with the joystick 13a. When the operator finds, by 
observing the image on display monitor 30, an image 
field at which an action is desired, the mouse button 15 
is pressed. The pressing of button 1 5 is detected in step 
332. The pressing of the mouse button 15, while under 
joystick 13a control, establishes the image field present 
when the button is pressed as an action point. In 
response to the press of mouse button 15, an action 
selection menu is displayed on instruction monitor 52 in 
step 334. This action selection menu is substantially 
identical to action selection menu 278 of FIG. 19. The 
mouse 13 is used to select in step 336 one of the listed 
actions for association with the action point then repre- 
sented on display monitor 30. Upon selection of the 
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action, a position record is created and stored (step 
338) in the slide tray data file 280 (FIG. 17). After the 
new position record is stored in the data file, the list of 
joystick actions is checked in step 340 to determine if 
further joystick actions are present. When additional 5 
joystick actions are present, the flow returns to step 329 
to perform again the above-described sequence. Alter- 
natively, when no joystick actions remain, the flow pro- 
ceeds to action step 344 in which the performance of 
the actions now specified in slide tray data file 280 are 10 
performed. 

In action step 344, the slide headers e.g., 282 (FIG. 
17) are reviewed in sequence from slide 101 through 
slide 108 to identify slides to be analyzed. When a slide 
header for a slide to be analyzed is accessed, its asso- is 
ciated position records are accessed in sequence to 
control the operation of the analysis apparatus. In 
response to each position record in slide tray data file 
280, the objective 64a is substantially aligned with the 
action point defined in the position record, and the asso- 20 
ciated action stored in the position record is performed. 
When the action is a show field action 345, the assay 
processing system 11b is controlled to present the 
image at the action point to display monitor 30 and to 
record a copy of the image. After such recording, flow 25 
returns to the action step 344 for the analysis of another 
position record. When a position record includes a set 
light or check light action, the set 346 or check light 347 
function respectively is performed after movement of . 
the apparatus to the action point defined in the position so 
record. The remaining action type is performed through 
action function 344 is the scan action 348, which is 
shown in greater detail in FIG. 23. 

The scan action begins at step 350, in which the 
slide tray 62a is controlled to move the image field at the 35 
selected action point to microscope objective 64a. As 
previously discussed, the field is focused after each 
move operation. The image field at the action point is 
then analyzed in step 352 to determine whether the 
image field has analysis value. The scan criteria of the 40 
present position record is consulted to determine the 
definition of a good field. For example, in the scan crite- 
ria represented in the menu 279 (FIG. 20) a good field is 
one in which 70% of its area comprises cell objects. 
When the image field does not have analysis value, the 45 
flow returns to block 350 where the slide tray is moved 
to place a new image field under objective 64a. The 
type of move operation performed is controlled by the 
previously established scan type, X step rate and Y step 
rate stored in the position record type for the present so 
action point. For example, if the scan type is set to verti- 
cal scanning and the Y step rate to 2 apparatus 11b 
would be controlled to move in the Y direction by two 
fields and stop to image a new field. After the new 
image field is focused, it is again analyzed in step 352 ss 
for a determination of its value for analysis. When the 
analysis value step 352 determines that the current 
image field has analysis value, flow proceeds to step 
354 where the attributes of the cell objects in the image 


field are measured and recorded. Next a pixel image of 
the current image f ield is stored in bulk data storage in 
step 356 and a step 358 is performed to determine if the 
end of the scan has been reached. The end of scan cri- 
teria are stored along with other scan criteria in the cur- 
rent position record. When the end of scan has not been 
reached, flow returns to step 350 from which a new 
image field is found and analyzed. When step 358 
determines that the end of scan has been reached, a 
step 360 is performed to determine the sample type of 
the cell objects being analyzed. If the sample type is a 
calibrate sample, the calibrate values are computed and 
stored in a step 362 and the flow returns to the action 
step 344. Alternatively, when step 360 determines that a 
specimen sample has been scanned, flow returns 
directly to the action step 344. When in action step 344, 
the computer 32 again reviews the slide tray data file to 
identify additional, unserviced position records. Action 
step 344 will service these unserviced position records 
until all have been serviced. At which time, a message 
is displayed on instruction monitor 52 which indicates 
the completion of the present analysis operation. 

In the preceding embodiment the operator enters a 
sample type during the setting of scan criteria (FIG. 20). 
As specifically disclosed, the sample type is either spec- 
imen or calibrate. Other choices of sample type could 
also be available without departing from the invention. 
For example, the type of assay such as DNA mass 
assay or red Wood cell hemoglobin assay, could be set 
as sample types and the apparatus 10 could analyze 
the measured and recorded attributes accordingly. Also, 
each slide in a slide tray could include different types of 
cell samples such as blood cells or tumor cells prepared 
in a manner specific to that type of cell sample. In such 
situations, the operator would enter the cell type during 
the label slide routine 255. The analysis apparatus 
would then read the sample type from the slide header, 
e.g., 282 to cause the appropriate analysis routines to 
be executed. 

The disclosed embodiments present an automated . 
biological specimen analysis method and apparatus. 
Improvements are disclosed which permit an operator 
to preselect action points on one or more slides. The 
automated apparatus responds to the preselected 
action points by moving directly to them without the inef- 
ficiencies of a search routine. Advantageously, an 
action point pre-selection embodiment includes the abil- 
ity to specify and record an action to be performed at 
each action point. Certain actions have been specifi- 
cally disclosed, however, persons of ordinary skill in the 
art may include other actions without departing from the 
invention. Additionally, the disclosed embodiments use 
display monitors and menus for data entry. Other types 
of data entry could be used without departing from the 
invention. 

Claims 

1 . A microscope slide viewing apparatus comprising: 
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a slide tray (62a) for securing a plurality of 
slides (101-108) in predetermined positions, 
said slides (101-108) being secured such that 
an upper surface thereof is substantially copla- 
nar, 

reference marked means (251) having a sur- 
face with a plurality of substantially identical 
reference patterns marked thereon, and 


10 


means for holding said slide tray (62a) in sub- 
stantially fixed position with respect to said ref- 
erence marked means (251) such that one of 
said reference patterns can be viewed on each 
of said plurality of slides (101-108). 75 

An apparatus in accordance with claim 1, wherein 
said slide tray (62a) holds said slides (101-108) in 
side-by-side relationship and said reference 
marked pattern means (251 ) has a plurality of refer- 20 
ence patterns in side-by-side relationship corre- 
sponding to the side-by-side relationship of said 
slides in said tray. 
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